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Abstract. We prove an n-EXPTlME lower bound for the problem of de- 
ciding the winner in a reachability game on Higher Order Pushdown 
Automata (HPDA) of level n. This bound matches the known upper 
bound for parity games on HPDA. As a consequence the /x-calculus model 
checking over graphs given by n-HPDA is n-EXPTlME complete. 



1 Introduction 

Higher Order Pushdown Automaton (HPDA) is a classical model of computation 
[6,7] that has recently regained attention. In [9] it has been proved that the MSO 
theory of the computation trees of HPDA is decidable. Then in [5] a new family 
of infinite graphs, also with a decidable MSO theory, has been introduced, which 
is closely related to HPDA (see [2,4]). See also other approaches in [1,3]. Up to 
now the Caucal hierarchy of [5] is essentially the largest class of graphs with 
a decidable MSO theory. But these decidability results have non-elementary 
complexity, even for a fixed level of the hierarchy. Considering /i-calculus model- 
checking and parity games allows to have better complexity bounds. 

We consider the question of deciding a winner in a reachability game given by 
a HPDA. It was shown by the first author [2] that parity games on n-HPDA's can 
be solved in n-EXPTiME. This also gives n-EXPTiME algorithm for the /u-calculus 
model checking over such graphs. Here we complement the picture by showing 
that even reachability games are n-EXPTiME hard on n-HPDA's, thereby showing 
n-EXPTiME completeness for game solving and /i-calculus model checking over 
n-HPDA's. 

It was already shown by the second author in [10] that pushdown games 
(on 1-HPDA) are EXPTiME-complete. We extend the technique with codding 
big counters, following the notation from [11], where the computation of space 
bounded Turing machines are written with the help of 1-counters of n-bits, 2- 
counters of 2" bits and so on. The expressive power of HPDA is used to "copy" 
parts of the store and check equality of big counters. 
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(contract HPRN-CT-2002-00283), see www. games. rwth-aachen.de. 



In the next section we present the definitions of game and HPDA. In Sec- 
tion 3 we prove the lower bound using a reduction from the word problem for 
alternating HPDA and a result by Engelfriet. The rest of the paper is devoted 
to an alternative, self contained and hopefully simple, proof of the lower bound. 
Using HPDA we show in Section 4 how to handle counters of level 1 and 2. and 
then of higher levels. In Section 5 we use counters to encode configurations of 
Turing Machines and prove the lower bound. 

We assume that the reader is familiar with the basic notions of games (see 
[8] for an overview). 

2 Definitions: Game, HPDS 

2.1 Game 

An arena or game graph is a tuple {Vo,Vi,E), where V = Vn itiVi is a set of vertices 
partitioned into vertices of Player and vertices of Player 1, and E CV x V is 
a set of edges (directed, unlabeled). Starting in a given initial vertex ttq G V", a 
play in {Vq, Vi. E) proceeds as follows: if ttq G Vq, Player makes the first move 
to TTi with ttqEtti, else Player 1 does, and so on from the new vertex tti. A play 
is a (possibly infinite) maximal sequence ttotti • • • of successive vertices. For the 
winning condition we consider reachability: a subset F CV is fixed, and 

Player wins tt iS 3i : Wi G F . 

As soon as F is reached, the play stops. The play can also stop when a position is 
reached with no outgoing edges. In this case the player who is supposed to move 
loses. A strategy for Player is a function associating to each prefix ttoTTi • • • 7r„ 
of a play such that 7r„ £ Vq a "next move" T^n+i with 7r„i!^7r„_|_i. We say that 
Player wins the game from the initial vertex ttq if he has a winning strategy 
for this game: a strategy such that he wins every play. 

2.2 Higher Order Pushdown System 

We recall the definition from [9] (which is equivalent to the one from [6]), where 
we slightly change the terminology. A level 1 store (or 1-store) over an alphabet 
r is an arbitrary sequence 71 ■ • • 7^ of elements of with £ 0. A level k store 
(or k-store), for fc ^ 2, is a sequence [si] ■ ■ ■ [sf] of {k — l)-stores, where £ ^ 0. 
The following operations can be performed on 1-store: 

p2ishj{"fi ■ ■ ■ 7£_i7£) := 71 • • • 7£-i7£7 for all 7 G T , 
popiiji ■ ■ ■ 7€-i7€) := 71 • • • le-i ) 
top(7i • • -7^-17^) := 7£ . 
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If [si] • • • [si] is a store of level fc > 1, the following operations are possible: 



pushk{[si] ■ 


■ [se^ 


-i]W) 


= N--- 


[se- 


-i][si][se] , 




pushj{[si] ■ 


■ [Si- 


-M) 


= [s,]--- 


[Si- 


.i]\pushj{ 


se)] if 2 ^ j < fc , 


pushj{[si] ■ 


■ [se- 


-i]N) 


= [s,]... 


[se- 


.i]\pushj{ 


se)] for all 7 G r 


popk{[si] ■ 


■ [se- 


-i]N) 




[se- 


-i], 




POPj{[Sl] ■ 


■ [se- 




= N--- 




-i]\poPjise 


)] if 1 < j < fc , 


top{[si\ ■ 


■ [se- 




= top{se) 









The operation popj is undefined on a store, whose top store of level j is empty. 
Similarly top is undefined on a store, whose top 1-store is empty. We will consider 
"bottom store symbols" & F a,t each level 1 < j < fc. When a j-store is 
empty, implicitly its top symbol is _Lj. These symbols can neither be erased 
nor "pushed" . Given F and fc, the set Opk of operations (on a store) of level fc 
consists of: 

pushj for all 2 < j < fc, pushj for all 7 S .T, popj for all 1 < j < fc, and skip . 

The operations pushj , allowing to "copy" a part of the store, are responsible for 
the fact that the hierarchy of HPDS is strict. A higher order pushdown system of 
level fc (or fc-HPDS) is a tuple H = {P, F, A) where P is the finite set of control 
locations, F the finite store alphabet, and ACPxFxPx Opk the finite set 
of (unlabeled) transition rules. We do not consider HPDS as accepting devices, 
hence there is no input alphabet. The name HPDS is derived from Pushdown 
System (PDS), it is a HPDA with unlabeled transitions. A configuration of an 
fc-HPDS _ff is a pair {p, s) where p G P and s is an fc-store. The set of fc-stores 
is denoted S^k- A HPDS H — {P, F, A) defines a transition graph {V, E), where 
V = {{p, s) : p G P, s £ ^k} is the set of all configurations, and 

{p, s)E{p', s') 3(p, 7,p', 6) e A: top{s) = 7 and s' = e{s) . 

For our constructions it would be simpler to assume that fc-HPDS can work 
also on stores of lower levels, in particular on 1-stores. Of course we can always 
simulate a j-storc, for j < k with an fc-storc but in the notation it requires some 
additional parenthesis that make it less readable. 

To define a game on the graph of a HPDS, we assign a player to each control 
state, and wc consider an initial configuration: a game structure on a HPDS H 
is a tuple ^ = (if, Pq, Pi, Sq), where P = Pq W Pi is a partition of the control 
states of H, and sq € S^k- This extends naturally to a partition of the set of 
configurations: with the notations of Section 2.1, Vq = Pq x S^ki Vi = Pi x S^ki 
and E is defined above. 

3 Reduction from the Word Problem 

Higher Order Pushdown Automata were originally designed to recognize lan- 
guages. In the usual way transitions can be labeled by letters from an input 



3 



alphabet A. A non-deterministic HPDA is defined like a HPDS above except 
that ACPxTx^AU {e}) x P x Op„. A transition can "read" a symbol from 
the input word or stay on the same place. The edges of the transition graph 
are labeled accordingly, and a word is accepted iff there exist a path from an 
initial configuration to a final configuration. Here the initial configuration can be 
chosen arbitrarily and the final configurations are defined by the control state. 

In an alternating (one-way) HPDA each control state is either existential 
(in Po) or universal (in Pi). A computation is a tree, from which the root is 
(POjSojO) where po is the initial control state, sq is the initial store content, 
and represents the leftmost position of the input word. If the input word is 
w = Wi . . .w\w\, then every non-leaf node {p,s,i) in the tree must satisfy the 
following. 

— If p e Po then there is a transition {p,'y,a,p',6) € A such that top{s) = 7 
and 

• either a = Wi+i and the node (p, s, i) has one child {p' , 9{s),i + 1), 

• or a = e and the node {p, s, i) has one child {p' , 0{s), i). 

- If p e Pi then 

• for each transition (p, 7, a,p' , 9) E A such that top{s) = 7 and a = Wj+i, 
the node {p, s, i) has a child {p' , 0{s), i + 1), 

• and for each transition {p, 7, e,p', 9) G A such that top{s) = 7, the node 
{p, s, i) has a child {p', 9{s), i). 

A word w is accepted if there exists a computation tree such that every leaf is 
(labeled by) an accepting state. 

It is well known that there is strong connections between alternation and 
games (sec e.g. [8]) but these connections depends very much on the context 
(finite/infinite words, epsilon-transitions allowed or not, . . . ). 

Let Tower stand for the "tower of exponentials" function, i.e., Tower{0, n) = 
n and Tower{k+l,n) = 2'^°"'«''('='"). One of the results of [7] is that given fc > 0, 
the class of languages of alternating level k HPDA is the class 



where n is the length of the input word. 

Given a fc-HPDA H = (P, P, A) and a word w, our aim is to define a fc-HPDS 
G and a game structure on G such that Player wins if and only if w is accepted 
by H. Because in the game there is no input word, the idea is to encode w in the 
control states and in the transitions of G. Let Q = Px[0, \w\] and G = [Q, P, A') 
where 



The set Qo of control states where Player moves is Po x [0, |7i'|] , corresponding to 
existential states. The set Qx where Player 1 moves is Pi x [0, l^l], corresponding 
to universal states. The goal set F is given by the final state(s) of H. 




(1) 



^' = {{{p,i),l,{p',i + '^),0) : {p,j,a,p',e) G A and w^+i = a} U 
{{{p,i),^,{p',i),9) : {p,^,s,p',9) € A} 
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Proposition 1 Given an alternating (one-way) HPDA H and an input word w 
one can construct in polynomial time a game structure on a HPDS of the same 

level and, whose size is linear in \H\.\w\. 

Note that this proposition can be easily extended to ahernating two-way HPDA. 
From the results of [7] (see (1) above) it follows that for every fc > and d > 
there is a HPDA H of level k such that the word problem for H cannot be 
decided in less than DTIME{Tower{k,dn)). It follows from this fact and the 
previous proposition that a game on a HPDS G of level k and size \G\ cannot 
be solved in less than DTIME{Tower{k, \G\)). 

Theorem 2 Reachability games on k-HPDS are fc-EXPTiME hard. 

Note that given an alternating HPDA H, one can simply remove the transition 

labels and the input alphabet, keeping the same set of control states. The game 
structure G obtained is such that: if some word is accepted by H then the game 
is won by Player 0, but the converse is not true. So there is no clear link between 
the emptiness problem and the game problem. The situation is different if one 
considers infinite words (a Biichi acceptance condition), a unary alphabet and 
no epsilon-transitions. 

4 Counters 

In the rest of the paper we give an alternative proof of Theorem 2. Our final 
aim will be to encode computation of fc-EXPSPACE boimded alternating Turing 
machines using /c-HPDS. As a preparatory step we will show that using fc-HPDS 
we can manipulate numbers of up to Tower{k,n). 

4.1 Alphabets 

For each index i > 1 we consider the alphabet Si = {ttj, fej}, where Oj and bi 
are associated to a and b when regarded as letters of the Turing machine, and 
to and 1 when regarded as bits (respectively). This conventions will be used 
through-out the rest of the paper. 

4.2 2-counters 

As an introductory step we will show that we can count up to 2^" using 2-store. 
Definition 3 Given n > 0, a 1-counter of length n is a word 

it represents the number Y^"^q cri2* (recall that the letter ai represents and the 

letter bi represents 1.) 

So we use counters of n bits, and the parameter n is now fixed for the rest of 
this section without further mentioning. 
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Definition 4 A 2-counter is a word 



where fc = 2" - 1, for all i G [0,2" - 1] we have a, G S2 and t, G (^1)" is 
a \- counter representing the number i. This 2-counter represents the number 

We will sec how to force Player to write down a proper counter on the store. 
More precisely wc will define states that we call tests. From these states it will be 
possible to play only a finite game which will be designed to test some properties 
of the stack. For example, Player will win from [counter i, u) iff a suffix of u is 
an i-counter. 

From a configuration (counter i,u) we want Player to win iff on the top of 
the stack there is a 1-counter; more precisely when u has a suffix (T2Wf2 ^ov 
V G (i^i)" and (72, G X'2. To obtain this we let Player 1 pop n + 2 letters 
and win if inconsistency is discovered; if no inconsistency is found then Player 
wins. Similarly we can define firsti and lasti from which Player wins iff on the 
top of the stack there is a 1-counter representing and 2" — 1 respectively. 

In a configuration {equali,u) we want Player to win iff the two topmost 1- 
counters have the same value; more precisely when a suffix of the stack u is of 
the form (J2va'2va2 with v G (-S'l)", C2, o'2, C2 G i72. In the state equal^ Player 1 
has the opportunity either to check that there arc no two 1-counters on the top 
of the stack (which is done with counter i), or to select a position where he thinks 
that the counters differ. To do this he removes from the stack up to n letters in 
order to reach a desired position. The bit value of this position is stored in the 
control state and then exactly n + 1 letters are taken from the stack. Player 1 
wins iff the letter on the top of the stack is different from the stored bit value; 
otherwise Player is the winner. 

Similarly, in a configuration (swcci,u) Player wins iff the two topmost 1- 
counters represent successive numbers; more precisely when u has a suffix of 
the form a2va2v'(72 with v,v' G (^1)" representing consecutive numbers, and 
a2,o''2,<72 G ^2- As before Player 1 has an opportunity to check if the stack 
does not end with two 1-counters. The other possibility is that Player 1 can 
select a position where he thinks that the value is not right. First he can "pop" 
any number of letters. During this process, the control state remembers whether 
the letter bi (which represents 1) has already been seen: because lowest bits are 
popped first, as long as ai are popped, we know the corresponding letter in the 
other counter should be a 61. After the first hi, the letters should be the same 
in the other counter. Then exactly n + 1 letters or popped (including a'2) and 
Player 1 wins if the letter is not right; otherwise Player wins. 

Starting from a configuration [counter 2, u) we want Player to win iff on the 
top of the stack there is a 2-counter; more precisely when u has a sufSx asva'^ 
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with 0-3, o-g G IJ3 and v a 2-counter. A 2-counter is a sequence of 1-counters, 
and the task of Player 1 is to show that u has no suffix of the right form. One 
way to do this is to show that u does not end with a 1-counter or that this last 
counter does not have value 2" — 1. This Player 1 can do with lasti test. Other- 
wise Player i can decide to show that there is some part inside the hypothetical 
2-counter that is not right. To do this he is allowed to take letters from the stack 
up to some S2 letter at which point he can check that the two topmost counters 
have wrong values (using test succi). This test can be performed only if Player 
does not claim that the counter on the top represents 0. If Player claims this 
then Player 1 can verify by using test first i- It should be clear that if u does 
not end with a 2-counter then Player 1 can make the right choice of a test and 
win. On the other hand if u indeed ends with a 2-counter then Player wins 
no matter what Player 1 chooses. Similarly we can define first2 and last2 from 
which Player wins iff the top of the store is a 2-counter representing values 
and 2^" — 1 respectively. 

Next we want to describe equal2 test for which we will need the power of 2-stores. 
We want Player to win from a configuration {equal2, u) iff there is a suffix of u 
consisting of two 2-counters with the same value; more precisely a suffix of the 
form a^va'^va'^ with v a 2-counter. If u does not end with two 2-counters then 
Player 1 can check this with counter2 test and win. If u indeed ends with two 
2-counters then Player 1 needs to show that the values of these counters differ. 
For this he selects, by removing letters from the store, a position in the topmost 
counter where he thinks that the difference occurs. So the store now finishes 
with ava', where a, a' S S2 and w is a 1-counter. Next Player 1 performs push2 
operation which makes a "copy" of 1-store. The result is: 

[u' ava'][u' ava'] . 

It is then the turn of Player to pop letters from the copy of the store in order 
to find in the second counter the position with number v. We can be sure that 
Player stops at some position of the second counter by demanding that in the 
process he pops precisely one letter from S3. After this the store has the form: 

[u'ava'] [u" pwp'] . 

From this configuration Player wins iS v = w and a' = p'. This test can be 
done in the same way as equal^ test. 

Using similar techniques, it is also possible to define a test succ2 checking that 
the two topmost 2-counters represent successive numbers (from [0, 2^ — 1]). 

4.3 Counters of Higher Levels 

As expected fc-counters are defined by induction. 

Definition 5 For all k > 1 a A:-counter is a sequence of {k — l)-counters of the 
form: 
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where j = Tower{k—l, n) — l, for alii G [0,j] : ai € S). andli is a {k—l)-counter 
representing the number i. This k-counter represents the number J2i=o ^i^V 

To cope with fc-counters, A;-HPDS are needed. We want to define for all A; > 2 a 
fc-HPDS with the control states with the following properties: 

— from {counter k,u) Player wins iff ?i ends with a A:-counter; 

— from [firstf.,u), {lastk,u) Player wins iff u ends with a fc-counter repre- 
senting and the maximal value respectively; 

— from {equal f^, u) Player wins iff the two last /c-counters in u have the same 
value; 

— from {succk,u) Player wins iff the two topmost fc-counters represent suc- 
cessive numbers. 

This is done by induction on k, using hypotheses for lower levels as subpro- 
cedures. For k = 1 and = 2, we have shown the constructions in the previous 
subsection. In the following we consider some k > 2 and explain now the con- 
struction by induction. 

Starting from a configuration {counter k, u) we want Player to win iff on the 
top of the stack there is a fc-counter; more precisely that u has a suffix ak+iva'i._^_-^ 
with a-fc+i, (Tj._|_i e ^k+i and v a fc-counter. A fc-counter is a sequence of (fc — 1)- 
counters, and the task of Player 1 is to show that u has no sufSx of the right 
form. One way to do this is to show that u does not end with a (fc — l)-countcr 
or that this last counter does not have value Tower{k — 1, n) — 1. This Player 1 
can do with lastk-i test. Otherwise Player 1 can decide to show that there is 
some part inside the hypothetical fc-counter that is not right. To do this he is 
allowed to take letters from the stack up to some letter at which point he 
can check that the two consecutive topmost (fc — l)-counters have wrong values 
(using test succk-i). This test can be performed only if Player does not claim 
that the counter on the top represents 0. If Player claims this then Player 1 
can verify by using test first f,_i. Similarly we can define firstly and lastk test. 

Next we want to describe equalf. test for which we will need the power of 
fc-stores. We want Player to win from a configuration {equal f.,u) iff there is 
a suffix of u consisting of two fc-counters with the same value; more precisely a 
suffix of the form ^z^'z£," with z a fc-counter and G ^fc+i- If u does not 

end with two fc-counters then Player 1 can check this with counter k test and win. 
If u indeed ends with two fc-counters then Player 1 needs to show that the values 
of these counters differ. For this he selects, by removing letters from the store, 
a position in the topmost counter where he thinks that the difference occurs. So 
the store now finishes with ava', where a, a' £ Sk and is a (fc — l)-counter. 
Next Player 1 performs push2 operation which makes a "copy" of 1-store. The 
result is of the form: 

[u'£,z^' z'ava'][u'i,z£,' z'ava'] . 

This is a 2-store with two elements where 2; is a fc-counter and z' is a prefix of 

a fc-counter. 

It is then the turn of Player to pop letters from the copy of the store in 
order to find in the second counter the position with number v. We can be sure 
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that Player stops at some position of the second counter by demanding that 
in the process he pops precisely one letter from Sk+i- After this the store has 
the form: 

[u'^zC'z'ava'][u'^z"pwp'] . 

From this configuration Player 1 wins iS v w ot a' p' . Checking a' ^ p' 
is easy. The test whether v = w can be done in a similar way as equalf._i test. 
The difference is that now we have 2-store and equal works on 1-stores. We 
elaborate the construction as this is the place where the power of fc-stores really 
comes into play. 

We will construct states same\, for i < k, with the property that Player 
wins in a configuration with a, {k — i + l)-store of the form 

s[u{rava')][u' {r' pwp')] . 

iff a' = p' and v = w is a z-counter. Here a, a', p, p' G l^j+i , r, r' are sequences of 
letters, u, u' are {k — i)-stores and s is a {k — i + l)-store. The notation {ava') is 
to denote the first 1-store in the given store, hence ( ) stand for some number of 
nested [J parentheses. The verification we need in the last paragraph is precisely 
same'l~ as there we have a 2-store and compare (k — l)-counters. 

It is quite straightforward to construct samej.. Player 1 has the right to 
declare that either a' ^ p' or that the counters are not equal. Checking the 
first case is straightforward. To show that the counters are different, Player 1 
chooses j < n and pops j letters from w using popi. Then j and the top letter 
are remembered in the control state. Afterward popk-\ is performed and once 
more j letters are popped. Player 1 wins if the top letter is different from the 
one stored in the finite control. 

To construct same\. for i > 1 we proceed as follows. Player 1 has the possi- 
bility to check if a' = p' as before. The other possibility is that he can popi some 
number of letters finishing on a letter from Ei and without popping a letter from 
X'i+i in the process. The resulting configuration is of the form: 

s[u{rav(j')]{u' {r' pw'txt')] . 

The intuition is that Flayer 1 declares that at position xinv the value is different 
than r'. Now pushk-i+2 is performed giving the configuration 

[s[u{rava')][u' {r' pw'txt')]] [s[u{r ava' )][u' {r' pw'txt')]] . 

As we had {k — i + l)-store before, now we have {k — i + 2)-store consisting of 
two elements. 

Next we let Player to do popk-i and some number of popi operations to 
get to the situation 

\_s[u{rava')][u' {r' pw' txt')\] \s[u{rav' ^fy^f')\] . 

where he claims that x = y and t' = 7'. This can be checked from same^T^ 
state. 
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The procedure succk is implemented similarly to equalk- Here it is not the 
case that at each position in the counters bits should be the same. Nevertheless 
the rule for deducing which bit it should be is easy and the difficult part of 
comparing the positions is done using sarne^"^. 

5 Encoding Turing Machines 

In this section we will show how to encode computations of an EXPSPACE- 
boundcd Turing machine using 2-storc. Then wc will claim that the construction 
generalizes to alternating A;-expspace and {k + l)-stores. 

Fix M, an EXPSPACE-bounded alternating Turing machine (TM), as well as 
an input word of length n. The set of control states of the TM is denoted Q. A 
configuration of M is a word over A2 = {02, ^2} U Q U {h, H} of the form 

h Ui • • • UiqUi+i ■ ■ - Uj -\ 

where q € Q, Vk : Uk <E {02, 62}- Here the TM is in state q, reading letter Ui+i. 

We will encode configurations of M almost in the form of 2-counters to write 
them in the store of a HPDS. Let fc = 2". A configuration ctoCTi • • • crfc_i e (^2)*^ 
is represented by a word 

^ak-iik-i ■ ■ -a-iiiaoioS, , 

where for all i e [0, 2" — 1]: ai e A2, £i G (-S'l)" is a 1-counter representing the 
number i, and £, £ S3 is a, separator. 

A computation is represented as a string obtained by concatenation of config- 
urations. The game will proceed as follows: departing from the initial configura- 
tion of the Turing machine (the input word), Player is in charge of building an 
accepting run and Player 1 is in charge of checking that no error occurs. Player 
simply writes letter by letter a configuration. If the state of the configuration 
is existential then after writing down the configuration Player writes also a 
transition he wants to perform. Otherwise it is Player 1 who writes the transi- 
tion. Then Player continues with writing a next configuration that he claims 
is the configuration obtained by the transition that was just written down. This 
process continues until a configuration with a final state is reached. At the end 
of writing each configuration Player 1 has the opportunity to check if the last 
two configurations on the stack indeed follow from each other by the transition 
that is written between them. 

Let us describe some details of this construction. Applying a transition rule 
of the Turing Machine consists in rewriting only three letters: Ui, q and 
in the notation of the example above. To check that the transition is legal, we 
will proceed in several steps. After writing a configuration, ended by a separator 
G S3, Player has to write again the three letters Uiqui+i. Then, depending 
whether state q is existential or universal in the TM, Player or Player 1 writes 
three other letters of A2, say q'ac, such that (uiqUi-^-i , q' ac) is a transition rule 
of the TM. The other player can test that this transition rule is indeed in the 
TM. 
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After that Player has to write down the configuration obtained by the cho- 
sen transition, and Player 1 has the opportunity to test wlic'ther this is correct. 
To do this he has several possibilities. First he can check that the newly written 
configuration is of a correct form, using a test similar to counter 2, replacing E2 
by A2. 

Otherwise he can check that this two last configurations are identical, except 
for the part involved in the transition rule. The store at this point is: 

s ^ciC UiQUi+iq'ac ^C2^ , 

where s is a prefix of computation, ci and C2 arc the last two configurations 
separated by the chosen transition. We describe a game from a state trans2 
such that Player wins from trans2 and the store as above iff the two topmost 
configurations obey the transition rule written between them. The test trans2 
has the same structure as the test equal2- Player 1 has first to pop letters to 
select a position in the configuration, that is a 1-counter. Each time he wants 
to pop next 1-countcr he asks Player if this position is the rightmost position 
involved in the transition or not. If yes then Player 1 has to pop three counters at 
the time, if not he pops one counter. Finally, Player 1 stops at a position where 
he thinks that an error occurs. He asks Player if this position is the rightmost 
position of the transition. If Player says that it is not then it is tested that at 
the same position in the preceding configuration there is the same letter; this is 
done in the same way as equal2 test. 

If Player claims that the chosen position is the rightmost position of the 
ones involved in the transition then the test is slightly more complex. A push2 
is performed and the store becomes 

[s ^ci^ UiQUi+iq'ac ^C2 pvp'v' p"v"][s ^ci(, Uiqui+iq'ac ^C2 pvp'v' p"v"] , 

where c'2 is a prefix of C2, p, p', p" G A2 and v, v', v" are 1-counters. Player 1 has 
the opportunity to check that q'ac = pp' p" , which is easy to implement. Player 1 
has also the opportunity to let Player find the position in ci corresponding 
to v" and then test that the corresponding letters from A2 are exactly Uiqui+i] 
this is implemented in a similar way as in equal2 test. 

The game is won by Player iff he can write an accepting configuration of 
the TM without Player 1 ever challenging him, or if Player 1 fails in some test. 
In other words the game is won by Player 1 iff he can prove that Player was 
cheating somewhere or if Player never reaches an accepting configuration of the 
TM. Examining the construction one can see that we need 0{n^ + |M|) states 
in 2-IIPDS to carry out the described constructions. So we have a poly-time 
reduction of the acceptance problem of alternating expspace Turing Machines 
to the problem of determining the winner in a reachability game over a 2-HPDS. 

Theorem 6 Reachability games on 2-HPDS are 2-EXPTlME hard. 

Together with the double exponential time solution of the more general parity 
games from [2], we have: 
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Corollary 7 Reachability /parity games on 2-HPDS are complete for 2-EXPTlME. 

Using the constructions of Section 4.3, it is easy to extend the encoding above 
and show that alternating fc-EXPSPACE Turing Machines can be simulated by 
{k + 1)-HPDS. Together with the results from [2] we get: 

Theorem 8 Reachability /parity games on k-HPDS are complete for A;-exptime. 

This result gives also a new proof that the hierarchy of HPDA is strict, and 
together with [2], that the Caucal hierarchy is also strict. 

6 Conclusion 

The fc-EXPTiME lower bound that we have proved in this paper shows that games 
are difficult on HPDA, even the simplest ones : reachability games. Surprisingly 
the complexity for solving parity games is the same as for reachability games. It 
is open to find algorithms or lower bounds for the model checking of other logics 
like CTL or LTL, that are weaker than the /U-calculus. 

Acknowledgment 

Many thanks to Luke Ong and Olivier Serre for interesting discussions. 

References 

1. A. BOUAJJANI and A. Meyer, Symbolic Reachability Analysis of Higher-Order 
Context-Free Processes, FSTTCS'04, LNCS 3328, pp. 135-147, 2004. 

2. T. Cachat, Higher order pushdown automata, the Caucal hierarchy of graphs and 
parity games, ICALP'03, LNCS 2719, pp. 556-569, 2003. 

3. A. Carayol, Regular Sets of Higher-Order Pushdown Stacks, MFCS'05, LNCS 
3618, pp. 168-179, 2005. 

4. A. Carayol and S. Woiirle, The Caucal hierarchy of infinite graphs in terms of 
logic and higher- order pushdown automata, FSTTCS'03, LNCS 2914, pp. 112-123, 
2003 

5. D. Caucal, On infinite terms having a decidable monadic theory, MFCS'02, LNCS 
2420, pp. 165-176, 2002. 

6. J. Engelfriet, Rerated push-down automata, 15th STOC, pp. 365-373, 1983. 

7. J. Engelfriet, Rerated stack automata and complexity classes , Information and 
Computation, 95(1), pp. 21-75, 1991. 

8. E. Gradel, W. Thomas and T. Wilke cds.. Automata, Logics, and Infinite 
Games, A Guide to Current Research, LNCS 2500, 2002. 

9. T. Knapik, D. Niwinski and P. Urzyczyn, Higher-order pushdown trees are 
easy, FoSSaCS'02, LNCS 2303, pp. 205-222, 2002. 

10. I. Walukiewicz, Pushdown processes: games and model checking, CAV'96, LNCS 
1102, pp. 62-74, 1996. Full version in Information and Computation 164, pp. 234- 
263, 2001. 

11. I. Walukiewicz, Difficult configurations — On the complexity of LTrL, 
ICALP'98, LNCS 1443, pp. 140-151, 1998. 



12 



